External Validity and Transportability: A Formal Approach
نویسندگان
چکیده
We provide a formal definition of the notion of “transportability,” or “external validity,” as a license to transfer causal information from experimental studies to a different population in which only observational studies can be conducted. We introduce a formal representation called “selection diagrams” for expressing differences and commonalities between populations of interest and, using this representation, we derive procedures for deciding whether causal effects in the target population can be inferred from experimental findings in a different population. When the answer is affirmative, the procedures identify the set of experimental and observational studies that need be conducted to license the transport. We further discuss how transportability analysis can guide the transfer of knowledge in non-experimental learning to minimize re-measurement cost and improve prediction power.
منابع مشابه
Transportability across studies: A formal approach
We provide a formal definition of the notion of “transportability,” or “external validity,” which we view as a license to transfer causal information learned in experimental studies to a different environment, in which only observational studies can be conducted. We introduce a formal representation called “selection diagrams” for expressing knowledge about differences and commonalities between...
متن کاملExternal Validity: From Do-Calculus to Transportability Across Populations
The generalizability of empirical findings to new environments, settings or populations, often called “external validity,” is essential in most scientific explorations. This paper treats a particular problem of generalizability, called “transportability”, defined as a license to transfer causal effects learned in experimental studies to a new population, in which only observational studies can ...
متن کاملMotivating the Additional Use of External Validity: Examining Transportability in a Model of Glioblastoma Multiforme
Despite the growing ubiquity of data in the medical domain, it remains difficult to apply results from experimental and observational studies to additional populations suffering from the same disease. Many methods are employed for testing internal validity; yet limited effort is made in testing generalizability, or external validity. The development of disease models often suffers from this lac...
متن کاملComments on 'Practical experiences on the necessity of external validation'.
The validity of prognostic models is an important prerequisite for their applicability in practical clinical settings. Here, we report on a specific prognostic study on stroke patients and describe how we explored the prediction performance of our model. We considered two practically highly relevant generalization aspects, namely, the model's performance in patients recruited at a later time po...
متن کاملTransportability of Causal Effects: Completeness Results
The study of transportability aims to identify conditions under which causal information learned from experiments can be reused in a different environment where only passive observations can be collected. The theory introduced in [Pearl and Bareinboim, 2011] (henceforth [PB, 2011]) defines formal conditions for such transfer but falls short of providing an effective procedure for deciding wheth...
متن کامل